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ABSTRACT 



The Aircraft Service Period Adjustment (ASPA) inspection/evaluation 
process for the Navy's S-3A Viking aircraft is presently a subjective 
assessment of the aircraft's general material condition. The purpose of 
this thesis is to quantify the ASPA inspection/evaluation process. The 
methodology used to quantify this process utilizes the Analytic 
Hierarchy Process (AHP) model. The AHP model is based upon three 
principles of logical analysis: (1) the principle of constructing 
hierarchies, (2) the principle of establishing priorities, and (3) the 
principle of logical consistency. This study presents a more efficient 
method of determining the aircraft induction decision than the current 
subjective ASPA procedures. Although the principle of logical 
consistency caused great concern amongst the authors, a methodology has 
been developed for quantifying the S-3A ASPA process that will assist 
NARF Alameda management in the control and documentation phase of the 
S-3A ASPA program. 
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LIST OF DEFINITIONS 



1. Initial Service Period (ISP) : The minimum time that aircraft in a 

reportable group (aircraft type) are expected to both safely and 

economically remain in service following fleet introduction or 

SDLM. This time period can be expressed in terms of months, flight 
hours or number of cycles and serves as the milestone for the 
initial ASPA evaluation. The ISP can be lengthened based on the 
ASPA evaluation results. 

2. Local Engineering Specification (LES) : Designed to assist depot 

level planners and estimators ( P&E ' s ) in the identification and 
correction of recurring, significant aircraft material maintenance 
conditions. 

3. Naval Air Rework Facility (NARF) : Organization responsible for 

coordinating and conducting Standard Depot Level Maintenance (SDLM) 
on fleet aircraft. 

4. Operating Service Months (OSM) : Applied to specific aircraft 

bureau numbers ( i . e . , serial number) and is the calendar months 

since acceptance/new or SDLM, whichever occurred last, less non- 

aging time (preserved and bagged). 

5. Operating Service Period (OSP) : The number of calendar months 

between SDLM inductions that an aircraft can safely and economic- 
ally operate. 

6. Period End Date (PEP) : The month and year in which the current 

Operating Service Period expires for a given aircraft and is 
subject to authorized adjustments (lengthening) resulting from ASPA 
evaluations or non-aging time. 

7. Standard Depot Level Maintenance (SDLM) : Series of tailored 

maintenance actions applied to specific aircraft bureau numbers; 

typically follows aircraft completion of an operating service 
period. 
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I. INTRODUCTION 



A. BACKGROUND 

The Aircraft Service Period Adjustment Program (ASPA) is now a 
reality for most aircraft in the U.S. Navy inventory. The primary goal 
of this program is the prevention of premature depot induction of fleet 
aircraft resulting in the unwarranted disassembly, inspection/evaluation 
and repair that Standard Depot Level Maintenance (SDLM) entails. The 
main feature of the ASPA program is an in-depth evaluation designed to 
reduce airframe maintenance budget costs and time spent overhauling 
airframe systems. 

The focus of this study deals with the quantification of the ASPA 
inspection/evaluation for the S-3A Viking aircraft. Built by Lockheed 
California Company, the S-3A has been the Navy's premier carrier-based 
antisubmarine platform designed to counter the surface and subsurface 
threat to the carrier battle group since 1975. The Viking incorporates 
both acoustic and non-acoustic sensors to enhance its weapon system in 
support of its primary mission. As the Cognizant Field Authority 
(CFA)/Designated Rework Point (DRP) for the S-3A aircraft and related 
equipment the Naval Air Rework Facility (NARF), Alameda, California has 
managed the ASPA program for the aircraft since its inception in 1984. 

B. OBJECTIVE 

Present inspection/evaluation procedures entail the subjective 
assessment of an aircraft's material condition. Historically, this 
subjective non-quantitative approach appears to have some weaknesses. 
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For example, inspections performed on the same aircraft by different 
ASPA inspectors have revealed inconsistent results. The primary purpose 
of this thesis is to attempt to eliminate this weakness by introducing 
quantifiable measures into the ASPA inspection/evaluation procedures for 
the S-3A in an attempt to provide consistency and objectivity. 

C. SCOPE 

Specifically, this thesis attempts to eliminate the inherent prob- 
lems associated with subjective evaluations through an application of 
the Analytic Hierarchy Process (AHP) model (developed by Thomas L. 
Saaty) to the ASPA inspection/evaluation. Aircraft general material 
condition is the primary criterion to be used in this approach. Consid- 
eration of cost factors was not possible due time constraints and lack 
of available data at the CFA/DRP level. 

D. PREVIEW 

Chapter II describes the evolution of the ASPA concept, and defines 
the process and key organizations involved. Chapter III presents an 
example utilizing the AHP methodology and its application to the S-3A 
ASPA program. Chapter IV discusses the relationship between the ASPA 
process and the principles of the AHP. Chapter V develops an observable 
scale which correlates ASPA inspection results to a weighted scale. 
Chapter VI presents conclusions and recommendations. 
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II. ASPA BACKGROUND 



The Department of the Navy (DON) has entertained various approaches 
to aircraft maintenance in an effort to preserve and maintain fleet 
operational readiness. The DON'S main objective has been to reduce 
total program maintenance costs by judiciously applying scarce depot 
rework assets as necessary without sacrificing fleet operational readi- 
ness. 

In the early 1970's, for example, the DON implemented a program 
similar to the Aircraft Service Period Adjustment (ASPA) program en- 
titled "Aircraft Condition Evaluation" (ACE). Unfortunately , introduc- 
tion of the ACE program significantly increased organizational (0-level) 
maintenance man-hours which revealed less than optimal results; there- 
fore, an unacceptable number of fleet aircraft were in a non-flight 
(disassembled) status for extended time periods. It was readily appar- 
ent to the DON that this maintenance philosophy (and others like it) 
resulted in poor budgeting practices and difficulty in quantifying depot 
level maintenance airframe requirements. Therefore, in 1982 the Naval 
Aviation Logistics Center (NAVAVNLOGCEN) proposed the ASPA program as a 
means of deferring SDLM for fleet aircraft by adjusting the Period End 
Date (PED). As a part of the Planning, Programming and Budgeting System 
(PPBS), the ASPA program is a significant departure from previous 
approaches. In contrast to the ACE program, ASPA provides a methodology 
for reducing maintenance costs in spite of ever-increasing material 
costs and wages. [Ref. l:p. 5] The remainder of this chapter is devoted 
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to a description and discussion of the significant aspects of the ASPA 
concept, process and key participants. 



A. INTRODUCTION 

The ASPA program philosophy focuses on the delicate, ever-changing 
balance between costs and readiness. The purpose of the program is 

two-fold. The primary purpose is to reduce maintenance costs of air- 
frames (SDLM costs) by lengthening the aircraft's operational service 
period (OSP). An important aspect of the primary purpose is 

. . . to identify those aircraft that are in significantly better 

condition than that warranting depot induction for the detailed 
disassembly, inspection and repair that SDLM entails. Airframes which 
meet the ASPA criteria are proposed for a twelve-month deferral of 
SDLM induction and that amount of time is added to the individual 
aircraft's Period End Date (PED). Aircraft failing an ASPA inspection 
must be inducted for SDLM as soon as possible, but in no case more 
than 90 days beyond the PED, or be grounded. [Ref. 2:p. 1] 

In direct support of the primary, a secondary purpose is 

... to define the airframe depot maintenance requirements based on 
actual assessment of the individual aircraft's material condition 
rather than a statistical prediction (i.e., rework on an as-needed 
basis) [Ref. 2 : p . 1]. 

ASPA is based on the premise that fleet aircraft, regardless of 
community type, will have a wide distribution of observable material 
conditions (due to differing flight environments - shore, carrier based, 
climate, etc.) at any particular point during service life or following 
any given number of individual aircraft operating hours. The mean level 
of material degradation that is expected at the PED may very well be 
considered "fleet average" for that particular aircraft type. Recent 
evidence, however, has recorded degradation levels for a specific 
aircraft which are lower than expected at the PED thereby allowing such 
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an aircraft to be safely kept in active service with no significant 
impact on readiness or costs. [Ref. 3:p. 17] 

B. ASPA PROCESS 

The ASPA process involves complex interaction and coordination 
between the cognizant field authority (CFA)/Designated Rework Point 
(DRP) and operational level activities (squadron). Historically, the 
end of the operating service period has been signalled by the PED, 
however, the implementation of the ASPA program revises this perspec- 
tive. Typically, fleet aircraft material condition is evaluated within 
the "ASPA window" or time frame which is normally six months prior to 
the PED. For those aircraft being deferred, elapsed time between the 
ASPA evaluation and the adjusted PED normally does not exceed 18 months; 
therefore, the deferral is for a maximum 12-month period. Induction 
into field support (FS) custody no later than ninety calendar days 
following PED is mandatory for those aircraft not recommended for PED 
adjustment. Those recommended for adjustment may have an unlimited 
series of aircraft material condition evaluations. [Ref. 3:p. 17] 

It is appropriate at this point to describe the ASPA program 
acceptance criteria and briefly discuss the responsibilities and 
functions of the key players involved in the ASPA process. 

1. Program Acceptance Criteria 

Aircraft under consideration for the ASPA program must meet the 
following conditions: 

(a) Only aircraft approaching their first tour (initial fleet 
operational in-service period) extensions are eligible. 
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(b) For transition (to ASPA) purposes, aircraft can be inspected as 
early as six (6) months prior to their PED. 

(c) Once an aircraft is on the ASPA schedule it will remain on the 
schedule. 

(d) Subsequent ASPA inspections will be performed 90 days prior to or 
30 days after the aircraft's PED. (SDLM normally commences at 
PED but due to operational requirements , a 30-day extension can 
be granted.) 

(e) Aircraft currently on an extension program will remain on that 
program until the aircraft starts a new tour (normally starts 
following SDLM). 

2. Responsibi 1 i ties /Functions 

a. Cognizant Field Authority (CFA) Involvement/Designated 

Rework Point (DRP) Involvement. 

Establishment of ASPA examination and evaluation require- 
ments, PED adjustment criteria, and program management as applied to 
operational aircraft custodians (squadron) is the direct responsibility 
of the CFA which is, for the purpose and scope of this thesis, the Naval 
Air Rework Facility (NARF) Alameda [Ref. 3:p. 17]. 

Effective and efficient execution of the ASPA process 
requires proper management and coordination at three levels within the 
NARF Alameda management framework. 

ASPA Program Level . Coordination at this level involves the 
S-3A Engineering Branch (to include Branch Head, engineers, Planners and 
Evaluators, etc.). It establishes policies and procedures within the 
CFA/DRP structure. 

Command Level . Responsible for establishing "consistency of 
purpose, timeliness and application of ASPA to the various aircraft 
programs assigned. An internal organization must be identified that 
consists of those major elements of the CFA/Prime DRP organization 
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having functional and/or program assignments that support the attainment 
of the ASPA objectives" [Ref. 3:p. 20]. 

Aircraft Program Level . Coordination at this level is the 
responsibi 1 i ty of both the CFA/Prime DRP and a DRP ASPA participant 
(i.e, NARF Alameda/S-3 Division and fleet squadron). The prime objec- 
tives of this level, in terms of coordination, are to ensure effective 
execution and uniform interpretation of Local Engineering Specifications 
(LES) by properly trained and qualified ASPA evaluators. Also, it is 
necessary to minimize the effect on fleet operations of problems (air- 
craft down-time, inspection scheduling, man-hours required, etc.) 
associated with conducting ASPA conditional MRC's. The management 
effort should facilitate timely data generation, feedback analysis and 
analytical reporting as well as actions necessary to correct material 
impediments or defects uncovered as a by-product of the ASPA inspection 
(i.e., ensuring that all discrepancies are properly documented by the 
aircraft custodian maintenance activity). [Ref. 3:pp. 20-21] 
b. Organization (Squadron) Level Involvement. 

The requirement to meet all operational commitments and to 
request, schedule and prepare aircraft and their operational/maintenance 
records for the ASPA inspection and evaluation is the direct respon- 
sibility of the reporting custodian (squadron) of the aircraft as the 
on-site representative of the Aircraft Controlling Custodian (ACC). In 
preparation for the ASPA inspection, with direct assistance and support 
from the CFA/Prime DRP, the squadron maintenance department should 
ensure that ASPA Maintenance Requirement Cards (MRC's) be prepared and 
validated in order to restore the aircraft, if necessary, to meet the 
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minimum material status (i.e., the aircraft is required to be in an "up" 
status) required for ASPA inspection eligibility. [Ref. 3: pp. 19-20] 

C. EVALUATOR QUALIFICATION PROGRAM 

In order to ensure that ASPA inspection and evaluation requirements 
are consistently applied, evaluator qualification standards are neces- 
sary. The need for consistent application of inspection procedures, 
with respect to the accuracy of inspection results, is quite critical 
since ASPA evaluations are presently subjective in nature. 

1 . ASPA Evaluator Requirements 

Qualifications for an individual desiring designation as an ASPA 
examiner is established by the Maintenance Engineering Cognizant Field 
Activity (MECFA) for aircraft programs under its cognizance. Typically, 
the qualifications are expressed in terms of desired experience levels 
(avionics, structural or hydraulics technician), required training or a 
combination of both, and are coordinated within the production 
department of the respective CFA to ensure that consistent, relevant 
requirements are maintained. 

2 . ASPA Evaluator Selection 

The selection of prospective ASPA evaluators is under the 
control of the CFA production department with a MECFA representative as 
a participating member of both the rating and selection panels [Ref. 3: 
pp. 34-351. 
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D. SUMMARY 



This chapter has discussed the development and objectives of the 
ASPA concept and key organizations involved because the purpose of this 
thesis is to develop a methodology for quantifying the ASPA inspection 
and evaluation process for the S-3A aircraft. Chapter III will address 
and describe the Analytical Hierarchy Process (AHP) model selected by 
the authors to provide this quantification. The details of the ASPA 
procedure for evaluating an aircraft's material readiness and a 
discussion of the relationship between the ASPA process and the AHP will 
be addressed in Chapter IV. Chapter V discusses the development of an 
observable scale for correlating ASPA inspection results to a weighted 
scale providing the necessary link to completely quantify a previously 
subjective process. Chapter VI presents a summary, conclusions and 
recommendations . 
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III. THEORETICAL FRAMEWORK OF THE ANALYTICAL HIERARCHY PROCESS 



A. INTRODUCTION 

The major research question of our thesis was to quantify a pre- 
viously subjective process in a manner which was consistent and logical. 
In our search for a model or methodology that would help answer this 
question, we decided to seek out a process which combined deductive and 
inductive approaches of the mind in an integrated and logical framework. 

The human mind organizes decision making methodology into two broad 
categories. The first category is the deductive or logical approach, 
and the second category is the inductive or systems approach. The 
logical categorization entails the analysis of a system via a generic 
networking scheme whose structure consists of various interconnected 
chains and cycles. Once the human mind structures the network it is 
easier to explain the function of each individual component and, by 
synthesis, the network is defined. The most serious drawback of the 
logical approach is that the feedback concept is not utilized. To 
correct for this omission, the human mind must employ the inductive 
approach, which looks at the general or holistic perspective and ignores 
each individual component's function. Clearly, both the deductive and 
inductive approaches contribute to the human mind's ability to 
understand and analyze complex systems. [Ref. 4:p. 5] 

B. THE ANALYTICAL HIERARCHY PROCESS 

The model which seems to best satisfy our criterion is the Analytic 
Hierarchy Process (AHP) developed by Dr. Thomas L. Saaty. The Analytic 
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Hierarchy Process is based upon three fundamental principles of logical 
analysis [Ref. 4:p. 17]: 

(1) The principle of constructing hierarchies. 

(2) The principle of establishing priorities. 

(3) The principle of logical consistency. 

In the following sections of this chapter we will explain how the 
Analytical Hierarchy Process can be utilized to quantify the currently 
subjective S-3 Viking Aircraft Service Period Adjustment (ASPA) program. 

Presently, the S-3 ASPA inspection is done by a Naval Air Rework 
Facility (NARF) Planner and Estimator (P&E). The P&E evaluator inspects 
the subject aircraft in accordance with the NARF Alameda S-3 ASPA Local 
Engineering Specification (LES) (Appendix A). A unique feature of the 
S-3 ASPA inspection is that zonal areas (i.e., the fuselage, rudder 
assembly, horizontal stabilizer, etc.) are inspected for deterioration 
instead of a leading indicator examination methodology (i.e., the hinges 
of the rudder assembly). 

Since the zonal area inspection method could produce many discrep- 
ancies ranging in severity from organizational to depot level repair 
required, we attempted to quantify the ASPA evaluation by weighting the 
various discrepancy categories available for assignment by the P&E 
evaluator. The first step in accomplishing this objective utilizing AHP 
was to structure a hierarchy of the problem being studied. 

1 . Structuring Hierarchies 

Saaty [Ref. 4:p. 17] expresses this view of the structuring of 
hierarchies: 

Humans have the ability to reduce a complex problem into various 

levels and sublevels as many times as necessary to simplify the 
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comprehension process. By the use of hierarchies one can show how 
changes in emphasis or priority on an upper level will effect the 
final outcome at the lower levels. 

Since we are trying to quantify the S-3 ASPA process via logical, 
analytical thinking (the main characteristic of AHP) we must structure 
the ASPA process in a manner which allows us to study each decision 
level independent of the ASPA process as a whole. The use of a 
functional hierarchy helped to accomplish this goal. 

The basic decision levels of the functional hierarchy are the focus, 
criteria, subcriteria and alternatives stage (Figure 1). The focus of 
the hierarchy is the broad, overall objective of the problem being 
studied. In the case of the ASPA evaluation process, the overall 
objective of the program is to identify aircraft for induction into 
Standard Depot Level Maintenance (SDLM) rework. The criteria of the 
hierarchy represents the forces which influence the focus. The major 
influential force in the determination of SDLM rework, according to the 
ASPA process, is the general material condition of the specific aircraft 
being inspected. The subcriteria of the functional hierarchy are the 
actors which determine the criteria. In our case, the subcriteria are 
the specific zonal areas the P&E evaluators inspect (Table 1 and 
Appendix B). These zonal areas are assigned a subjective grade, which 
is used by the P&E evaluator in his final determination of the general 
material condition of the aircraft. The final decision level of the 
functional hierarchy is the "possible alternatives" stage. This level 
of the hierarchy represents possible scenarios available within the ASPA 
process. Two courses of action are possible at this level: induct the 

aircraft or do not induct the aircraft into SDLM rework. 
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TABLE i. S-3 VIKING ASPA INSPECTION ZONES 



1 LEFT-HAND WING FOLD: OUTER WING PANEL 

2. LEFT-HAND WING FOLD: INNER WING PANEL 

3. RIGHT-HAND INNER WING PANEL SPAR AND FLAP WELL 

4. RIGHT-HAND OUTER WING PANEL AFT SPAR AND FLAP WELL 

5. RIGHT-HAND OUTER WING PANEL, TAB AND SPAR 

6. RIGHT-HAND WING FOLD: OUTER WING PANEL 

7. RIGHT-HAND WING FOLD: INNER WING PANEL 

8. LEFT-HAND INNER WING PANEL SPAR AND FLAP WELL 

9. LEFT-HAND OUTER WING PANEL AFT SPAR AND FLAP WELL 
10 HORIZONTAL STABILIZER 

1 1. LEFT-HAND ELEVATOR AND TAB 
! 2. RIGHT-HAND ELEVATOR AND TAB 

1 3. FIN FOLD 

1 4. RUDDER 
13. FUSELAGE 

16. ENVIRONMENTAL CONTROL SYSTEM COMPARTMENT 

17. LEFT-HAND MAIN LANDING GEAR AND WELL 

18. RIGHT-HAND MAIN LANDING GEAR AND WELL 

19. NOSE LANDING GEAR AND WELL 

20. OVERALL PAINT CONDITION 
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Once the hierarchial structure of the ASPA process had been spec- 
ified the next step is to determine the priorities between each decision 
level and every element within those levels. 

2. Setting Priorities 

The human mind has an innate ability to perceive relationships 
between items or facts we observe and assigns a relative importance to 
that event. By employing the Analytical Hierarchy Process in our study 
of the quantification of the S-3 ASPA program we have chosen a 
methodology that takes advantage of this thought process. 

The level of the functional hierarchy that required prioriti- 
zation was the subcriteria decision level. This level corresponds to 
the zonal area subjective judgments which are dominant in the ASPA 
evaluation process because the results of this level determine the 
induction decision. To answer our major research question we had to 
determine the relative priority, or percent contribution, each zonal 
area made to the criterion of general material condition and hence, the 
induction decision. 

The first step in establishing the relative priorities of the 
subcriteria level was to construct a Pairwise Comparison Matrix. This 
matrix allowed the NARF Alameda P&E's to compare each element (zonal 
area) against the other zonal areas and judge their impact on general 
material condition [Ref. 4:p. 76]. The matrix structure is a mathemati- 
cal tool that is well suited for this process (Figure 2). 

To begin the pairwise comparison process, the Analytical Hier- 
archy Process takes the first zonal area of the left-hand column and 
compares it to each zonal area in the top row. This process continues 
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Figure 2 . Pairwise Comparison Matrix Example 



working down the left-hand column until the matrix is completed. An 
important point to consider during the pairwise comparison process is 
the phrasing of the comparison question. The left-hand column is always 
compared to the top row to maintain the proper relationship between 
zonal areas with respect to the criterion of general material condition 
[Ref. 4:p. 77]. 

To assign a relative importance to each comparison a numeric 
scale has been developed by Saaty [Ref. 4:p. 78]. Table 2 presents the 
values available for assignment during the pairwise comparison process. 
This graduated scale represents the degree of intensity of which the 
human mind is capable of distinguishing between. 

As an example of how AHP works to this point, refer to Figure 2 
again. When Zonal Area One of the left-hand column was compared to 
Zonal Area One of the top row an intensity of importance factor of one 
(1) was assigned. By consulting Table 2, the definition of this inten- 
sity of importance factor is "equal importance of both elements". This 
point will be true whenever a zonal area is compared to itself, thus the 
diagonal of the Pairwise Comparison Matrix will always contain unity. 

Zonal Area One was then compared to Zonal Area Two and the 
example intensity of importance was determined to be five (5), which is 
defined as "essential or has a strong importance of one element over 
another". When Zonal Area One was compared to Zonal Area Three it was 
determined that area Three was more important by a factor of nine (9). 
This situation requires the use of reciprocal factors. When the top row 
area dominates, or is more important than the left-hand column area, the 
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TABLE 2. THE PAIRWISE COMPARISON SCALE 



Intensity of 

Imoortance Definition 


Explanation 


i Equal importance of both 

elements 


Two elements contribute 
equally to the property 


3 Weak importance of one 

element over another 


Experience and judgement 

slightly favor one element 
over another 


5 Essential or there exists a 

a strong importance of one 
element over another 


Experience and judgement 
strongly favor one element 
over another 


7 Demonstrated importance 

of one element over another 


An element is strongly 
favored and its dominance 
is demonstrated in prac- 
tice 


9 Absolute importance of one 

element over another 


The evidence favoring one 
element over another is of 
the highest possible order 
of affirmation 


2,4, 6,8 Intermediate values be- 

tween two adjacent judge- 
ments 


Compromise is needed 
between two judgements 
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reciprocal intensity of importance factor is assigned. Therefore, the 
comparison in our example is assigned the factor 0.11. 

The use of reciprocal factors also leads to a reduction in the 
work the evaluator must do when completing the matrix. Once the 
triangle above the diagonal is assigned the proper intensity of 
importance factors, the triangle below the diagonal can be completed 
through inference by entering the symmetrical reciprocal values as shown 
in Figure 3. 

The final zonal comparison is made between Zonal Area Two and 
Zonal Area Three with the resulting assignment of an example intensity 
of importance factor of three (3). When the pairwise comparison process 
is finished, the next step of the AHP is to determine the relative 
importance of each zonal area with respect to the stated criterion of 
general material condition. 

The first step in determining this value, termed the priority 
vector, is to sum each column of the matrix and divide each pairwise 
comparison factor by this sum to attain a normalized matrix (Figure 3). 
The normalized matrix permits a more meaningful comparison among zonal 
areas. [Ref. 4:p. 80] 

Finally, the normalized zonal areas are summed by row and this 
summation is divided by the number of zonal areas in the row [Ref 4 : p . 
81]. The result of this normalized matrix row averaging is the percent- 
age of overall relative priority for each zonal area with respect to the 
criterion of general material condition (Figure 3). 
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3 . Logical Consistency 



Logical consistency is the third principle of the Analytical 

Hierarchy Process. Saaty [Ref. 4 : p . 18] describes consistency as: 

. . .A trait that the human mind accomplishes in both the conscious 
and unconscious states. Humans have the ability to relate similar 
items, ideas and events in a harmonious manner for more efficient 
storage within the brain. Once the homogenous clumps have been filed, 
the intensity of the relationships are worked upon by the unconscious 
state of the mind by the application of a specific criterion with the 
result being either a strengthening or weakening of the individual's 
original classification scheme. 

Since the pairwise comparison process was conducted by the S-3 
Planning and Estimating (P&E) Branch of Naval Air Rework Facility (NARF) 
Alameda, a check for consistency of their subjective and experienced 
judgments was in order and is presented in Chapter IV. 

The consistency check advocated by Saaty involves the generation 
of a random pairwise comparison matrix. The idea of generating a random 
matrix allows us to compare truly random judgments versus the experi- 
enced judgments of the P&E evaluators. The deviation from consistency 
that results from this comparison is termed the Consistency Index (Cl), 
and is expressed mathematically as: 

Cl = lambda max - n 
n - 1 



where n equals the number of zonal areas (twenty in our problem) in the 
Pairwise Comparison Matrix. 

Lambda max (the principle eigenvalue) of the Cl equation is 
found by multiplying the zonal area priority vectors, as calculated in 
the pairwise comparison process, by each columnar element of the 
randomly generated matrix. The new row values are then summed and this 
summation is divided by the corresponding priority vectors of each zonal 
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area. The mathematical average of these quotients is found and this 
numerical value represents lamda max. [Ref. 4:p. 84] 

Once the Consistency Index of the Pairwise Comparison Matrix is 
found, a value termed the Random Index (RI) must be calculated. The RI 
is simply the consistency index of the random matrix. This value was 
calculated in the same manner as the Cl and is presented in Chapter IV. 

When the Consistency Index and Random Index have been cal- 
culated, the overall process consistency, or the Consistency Ratio (CR), 
can be found [Ref. 5 : p . 21]. The Consistency Ratio is expressed as: 

CR = Cl 
RI 

The acid test for consistency via the Analytical Hierarchy Process is to 
obtain a CR less than ten percent [Ref. 5:p. 21]. 

C. SUMMARY 

In this chapter we have presented the theoretical background 
necessary to understand how Saaty's Analytical Hierarchy Process works. 
We have emphasized that the AHP is based upon three fundamental 
principles of logical analysis: 

(1) Constructing hierarchies 

(2) Establishing priorities 

(3) Maintaining logical consistency 

These three principles set the framework upon which this chapter is 
structured. Within this framework we have outlined the procedures that 
must be accomplished when utilizing the Analytical Hierarchy Process to 
solve a complex problem. 
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D. PREVIEW 



In Chapter IV we will apply the three principles of the AHP to the 
S-3 ASPA process in an attempt to quantify a previously subjective 
process. By generating priority values for each zonal area of the S-3A 
Viking we will be able to generate an ASPA score that can be utilized in 
the determination of the induction decision instead of using the 
subjective judgment of the P&E evaluator. 
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IV. AN EXAMPLE OF THE METHODOLOGY 



A. AHP HIERARCHY STRUCTURE 

According to the Naval Aviation Logistics Center (NALC), the purpose 
of the ASPA program is to determine whether the specific aircraft being 
evaluated should or should not be inducted into Standard Depot Level 
Maintenance (SDLM) rework. The most important criterion used in accom- 
plishing this decision is the general material condition of the aircraft 
at the time of the ASPA evaluation. Thus, the first two levels of our 
AHP hierarchy are mandated by NALC. Level One, or the focus of the 
hierarchy, is the SDLM induction decision and Level Two, or the criter- 
ion of the hierarchy, is the general material condition of the aircraft 
being evaluated. 

The third level of the AHP hierarchy is defined as the subcriteria 
level. The subcriteria level of the hierarchy contains the variables 
necessary for determining the general material condition of the 
aircraft. These variables are defined by the NARF Alameda S-3A Local 
Engineering Specification (LES) of 7 Aug 1985 (Appendix A). 

The LES provides a detailed and comprehensive checklist of items to 
be inspected in the determination of an aircraft's general material 
condition. The P&E evaluator uses the LES during each ASPA evaluation 
and notes discrepancies in each zonal area by severity of defect (An 
example of a zonal area would be the fuselage of the aircraft and a 
common discrepancy would be chipped paint requiring an organizational 
level maintenance action to repair). 
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When the ASPA evaluation is complete the P&E evaluator totals the 
number of discrepancies and subjectively determines the overall general 
material condition of the aircraft. Based on this determination, the 
P&E evaluator either recommends that the aircraft be inducted into SDLM 
rework or remain on operational duty. This induction decision repre- 
sents the fourth level of the AHP hierarchy, the possible alternatives 
stage. Figure 4 presents a diagrammatic view of the completed hierar- 
chial structure as it applies to the ASPA evaluation process. 

B. PRIORITY DETERMINATION 

By incorporating the zonal areas of the S-3A LES into the sub- 
criteria of our hierarchy, we are proposing a method of reducing the 
subjectivity which currently exists within the ASPA evaluation process. 
Instead of a subjective input being used as the determining factor of an 
aircraft's material condition, we will employ the methodology of AHP to 
determine each zonal area's relative contribution (expressed as a 
percentage) to the criterion of general material condition. 

The AHP methodology employs the use of a matrix to determine the 
relative contribution of each element (zonal area) being studied. 
Figure 5 presents the Pairwise Comparison Matrix structure for the S-3A 
aircraft. As can be seen from this figure, the matrix provides a tool 
for comparing each zonal area to all of the zonal areas. 

The development of the Pairwise Comparison Matrix is the first step 
we will use to quantify a previously subjective process. The pairwise 
comparison process represents the P&E evaluator's decision regarding 
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CRITERIA 

genepal material condition 



ZONAL AREAS 

I 234567891011 1213141516171919 20 



2 

3 

4 

5 

6 

7 

8 
9 

ZONAL AREAS 10 

1 1 
12 

13 

14 

15 

16 

17 

18 

19 

20 

LIST OF ZONAL AREAS: 

1. LH WING POLO: OUTER WING PANEL 

2. LH WING FOLD: INNER WING PANEL 

3. RH INNER WING PANEL SPAR & FLAP WELL 

4. RH OUTER WING PANEL AFT SPAR & FLAP WELL 

5. RH OUTER WING PANEL, TA8 & SPAR 

6. RH WING FOLD: OUTER WING PANEL 

7. RH WING FOLD: INNER WING PANEL 

8. LH INNER WING PANEL SPAR & FLAP WELL 

9. LH OUTER WING PANEL AFT SPAR & FLAP WELL 

10. HORIZONTAL STABILIZER 

1 1. LH ELEYATOR &. TAB 

12. RH ELEYATOR & TAB 

13. FIN FOLD 

14. RUDDER 

15. FUSELAGE 

16. ECS COMPARTMENT 

17. LH MAIN LANDING GEAR & WELL 

18. RH MAIN LANDING GEAR & WELL 
1 9. NOSE LANDING GEAR & WELL 
20. OYERALL PAINT CONDITION 

Figure 5. Structure of ASPA Pairwise Comparison Matrix 



35 



which zonal area is most important/cri tical to the general material 
condition of the aircraft when matched against the other zonal areas. 

The possible decisions the P&E evaluator could make within the 
pairwise comparison process were previously presented in Table 2 of 
Chapter III. The numerical scale ranges in intensity of importance from 
one (equal importance of both elements) to nine (absolute importance of 
one element over another). These values are assigned by comparing the 
zonal areas of the left-hand column to the zonal areas in the top row. 
The emphasis on order of comparison is necessary to produce a ranking 
which is relative to our stated criterion of aircraft general material 
condition. 

As described in Chapter III, during the pairwise comparison 
process a zonal area which is considered more important than the zonal 
area it was being compared to was assigned a whole number. If the area 
is less important then the reciprocal intensity of importance is 
assigned. Figure 6 presents the Pairwise Comparison Matrix for the 
S-3A. This matrix was developed by a senior NARF Alameda P&E with the 
assistance of one member of the S-3A Engineering Branch. Consider, for 
example. Zonal Area 14, listed in the left-hand column of Figure 6. 
This area of the aircraft is the rudder assembly of the S-3A. When the 
rudder assembly was compared to the overall paint condition (Zonal Area 
20) the P&E evaluator decided that the rudder was more important to the 
criterion of general material condition of the aircraft by an importance 
factor of three (3). The assignment of an intensity of importance 
factor of three means the P&E evaluator felt that the rudder assembly 
exhibited "a weak importance" over the paint condition in the 
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determination of overall general material condition of the aircraft. 
When the rudder assembly was compared to the aircraft's fuselage (Zonal 
Area 15) the fuselage was adjudged to be more important with the 
resultant assignment of an importance factor of 0.25, or the reciprocal 
of four (4). The assignment of an intensity of importance factor of 
0.25 indicates the P&E evaluator felt that this comparison ranked 
between "weak importance" and "essential or there exists strong 
importance" of the fuselage over the rudder assembly. 

Once the matrix is filled, the procedure for determining the 
relative contribution (priority vectors) of the zonal areas can begin. 
First, all columns are totalled and the sum divided into all the ele- 
ments within the respective column. The result of this calculation is a 
normalized matrix as presented in Figure 7. The row sums of the 
normalized matrix are calculated next and then divided by the number of 
elements in the row, which is twenty (20). The end result of these 
simple mathematical calculations is the relative priority vector, or the 
relative contribution each zonal area makes to the overall general 
material condition of the aircraft (Figure 8). 

C. CONSISTENCY OF THE ANALYTICAL HIERARCHY PROCESS 

As mentioned in Chapter III, the Analytical Hierarchy Process should 
provide consistent results. In this section we will present the 
methodology used to calculate a numerical value for consistency as it 
applies to our problem. 
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ZONAL 

AREAS 

1 

2 

3 
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8 
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10 
1 1 
12 

13 

14 
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16 
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ROW 
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0.41097 

0.40908 

0.44096 

0.32313 

0.36121 

0.48314 

0.36056 

0.41226 

0.35320 

2.29376 

1.77777 

1.73062 

0.17944 

1.02913 

3.00147 

0.29663 

1.71741 

1.71741 

1.71741 

0.98444 



PRIORITY 
ELEMENT 
0.02055 
0.02045 
0.02205 
0.01616 
0.01806 
0.02416 
0.01803 
0.02061 
0.01766 
0.1 1469 
0.08889 
0.08653 
0.00897 
0.05146 
0.15007 
0.01483 
0.08587 
0.08587 
0.08587 
0.04922 



Figure 8. Row Suns arrd Priority Elements of 
the Pairwise Comparison Matrix 
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1 . The Randomly Generated Consistent Matrix 



To confirm that the judgments offered by the P&E evaluators were 
logical, and not merely random, we compared the Pairwise Comparison 
Matrix to a Randomly Generated Consistent Matrix. The intent of this 
comparison was to determine a value called the Consistency Ratio (CR), a 
numerical measure of AHP's consistency. The CR is derived by finding 
the Consistency Index (Cl) of the Pairwise Comparison Matrix and 
dividing this value by a factor known as the Random Index (RI). The 
Randomly Generated Consistent Matrix is a matrix generated by a random 
number generator using the same intensity of importance scale as was 
used for the Pairwise Comparison Matrix (0.11, 0.13, 0.14, 0.17, 0.2, 
0.25, 0.33, 0.5, 1 through 9). The matrix is termed consistent because 
the upper right triangle (above the diagonal) was generated, and the 
transpose positions (lower left triangle) were filled with the 
reciprocal values (Figure 9). 

The calculation of the Consistency Index of the Pairwise Compar- 
ison Matrix begins with the multiplication of the elements of the 
priority vector by each corresponding column element of the Randomly 
Generated Consistent Matrix. For example, the priority vector element 
for Zonal Area 15 (fuselage) is 0.15007. When this value is multiplied 
by the first element, 0.17, of the fifteenth column of the Randomly 
Generated Consistent Matrix a value of 0.02551 is obtained, as can be 
seen in Figure 10 (row 1, column 15). 

The next step in the process is to sum the rows of Figure 10 and 
divide this summation by the respective priority vector elements of the 
zonal areas. These quotients are then averaged to find a value termed 
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"lambda max". Lambda max is a key variable in the mathematical equation 
for the Consistency Index: 

Cl = lambda max - n 
n - 1 

where n represents the number of elements in the sample, in this case, n 
equals 20. 

The Consistency Index for the S-3A Pairwise Comparison Matrix was 
found to be 2.86555 as shown in Figure 11. 

2. The Randomly Generated Matrix 

To calculate the Random Index, or the random value of the 

Consistency Index, we must generate another random matrix (Figure 12). 
This matrix differs from the Randomly Generated Consistent Matrix in 
that all of the elements of this matrix were generated by the random 

number generator and not just the upper right triangle. To find the 

Random Index we first normalize the "consistent" matrix and determine 

the priority vector elements (Figure 13). Once the priority vector of 

the Randomly Generated Consistent Matrix is known we multiply these 
values by their respective column entries in the random matrix (Figure 
14). The row sums are calculated and these values are divided by the 
applicable priority vector elements to obtain the values in Figure 15. 
Lambda max is found in the same manner as for the Consistency Index. 
The lambda max value is then inserted into the equation for the Random 
Index : 

RI = lambda max - n 
n - 1 

and the Random Index is found to equal 3.72625 (Figure 15). 
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ZONAL 

AREAS 





ROW 


PRIORITY 




SUMS 


ELEMENT 


1 


1.55577 


75.71 17 


2 


2.48213 


121.353 


3 


3.26598 


148.130 


4 


2.01818 


124.915 


5 


2.41381 


133.650 


6 


1.62880 


67.4255 


7 


1.45650 


80.7919 


8 


2.30501 


1 1 1.823 


9 


0.92603 


52.4369 


10 


1.94390 


16.9494 


1 1 


3.05747 


34.3966 


12 


2.30229 


26.6065 


13 


1.19728 


133.449 


14 


1.77878 


34.5687 


15 


2.30282 


15.3446 


16 


3.16190 


213.187 


17 


1.15234 


13.4195 


18 


1.97314 


22.9781 


19 


2.55019 


29.6981 


20 


1.57871 


32.0732 




COLUMN SUM = 


1488.91 




LAMBDA MAX. = 


74.4454 



C. I. = 2.86555 



Figure 11. Row Sums, Lambda Max and Consistency 
Index of the Pairwise Comparison 
Matri x 
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ZONAL 

AREAS 

1 

2 
3 

5 

6 

7 

8 
9 

10 
1 1 
12 
13 
H 

15 

16 

17 

18 

19 

20 



ROW 

suns 

1.55577 

2.48213 

3.26598 

2.01818 

2.41381 

1.62880 

1.45650 

2.30501 

0.92603 

1.94390 

3.05747 

2.30229 

1.19728 

1.77878 

2.30282 

3.16190 

1.15234 

1.97314 

2.55019 

1.57871 



PRIORITY 

ELEMENT 

75.7117 

121.353 

148.130 

124.915 

133.650 

67.4255 

80.7919 

111.823 

52..4369 

16.9494 

34.3966 

26.6065 

133.449 

34.5687 

15.3446 

213.187 

13.4195 

22.9781 

29.6981 

32.0732 



COLUMN SUM = 1488.91 

LAMBDA MAX. = 74.4454 

C. I. = 2.86555 



Figure 15. Row Sums, Lambda Max, Random Index and 
Consistency Ratio of the Randomly 
Generated Consistent Matrix 
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3. Determination of the Consistency Ratio 



Once the Consistency Index of the Pairwise Comparison Matrix and 
the Random Index of the Randomly Generated Consistent Matrix are known 
the Consistency Ratio can be calculated by the following formula: 

CR = Cl = 2.86555 = 0.76715 
RI 3.72625 

This value, in our opinion, is too far from the AHP goal of 0.10 
to be considered a consistent result. Two factors that may have 
contributed to this unsatisfactory result are: 

(1) The judgments of the P&E evaluator used in the Pairwise 
Comparison Matrix were randomly chosen. 

(2) The Random Index of the Randomly Generated Consistent Matrix is 
not as accurate as it could be. 

We feel that factor (2), the inaccuracy of the Random Index, 
deserves a more in-depth explanation at this time. Saaty and his 
colleagues have worked extensively at developing average Random Indexes 
for matrices of order 1 to 15. [Ref 5:p. 21]. They have generated 
hundreds of matrices at each order and then averaged the resulting 
Random Indexes. What we have done, due to resource constraints, is 
generate one Random Index for a 20 by 20 matrix. In effect, we have 
been unable to follow published guidelines for dealing with matrices of 
this magnitude under the Analytical Hierarchy Process. However, it is 
questionable whether expending the effort to generate 100 random 
matrices of size 20 by 20 will be worth it. The concern in AHP is 
having consistency in the Pairwise Comparison Matrix, not whether it can 
be quantified or not. A suggestion for ensuring consistency of the 
Pairwise Comparison Matrix would be to gather the entire NARF Alameda 
P&E staff and utilize the Delphi method [Ref. 6] to find the zonal area 
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priority values. This methodology develops a consensus opinion of the 
entire group involved in the ranking task and thus eliminates the need 
to generate random matrices, or be concerned with monitoring 
consistency. 

D. SUMMARY 

In this chapter we have utilized the methodology of the Analytical 
Hierarchy Process to generate values which represent the contribution 
each zonal area makes to the criterion of general material condition of 
the S-3A aircraft. Unfortunately, we do not have an easy way to measure 
the consistency of opinion because of the difficulty of generating 
random matrices to obtain a comparison. This does not seem necessary 
anyway. The Delphi method [Ref. 6], developed by the Rand Corporation, 
can be used to aggregate the opinions of all involved P&E's and the 
results would, indeed, be consistent. 

E. PREVIEW 

In the next section we will develop an observable scale that can be 
used by the P&E evaluator when he conducts the S-3A ASPA inspection. 
This scale is necessary to reduce the P&E's evaluation of a specific 
aircraft to a single number, which is a step beyond the Analytical 
Hierarchy Process. The generation of a specific number to describe an 
aircraft's general material condition will make the SDLM induction 
decision much easier for NARF Alameda management. 
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V. DEVELOPMENT OF AN OBSERVABLE SCALE 



A. INTRODUCTION 

The Analytical Hierarchy Process provides us with the relative 
contribution each zonal area of the S-3 Viking makes to the general 
material condition of the aircraft. In the development of the observ- 
able scale we used the elements of the priority vector from the Pairwise 
Comparison Matrix to linearly weight the number and severity of the 
defects found by the P&E evaluator during the ASPA inspection. The 
decision to linearly weigh the number and severity of defects was 
reached by consulting the S-3A Engineering Branch of NARF Alameda. This 
procedure was deemed the most workable weighting scheme at this time. 

The P&E evaluator, through knowledge and work experience, determines 
the lowest level of maintenance required to restore a discrepancy to its 
original condition. The levels of maintenance that are possible for 

assignment include the organization/squadron or 0-level and the 

depot/NARF or D-level. The intermediate maintenance level is excluded 
as Aircraft Intermediate Maintenance Department^ ) (AIMD) do very 
little, if any, structural corrosion repair work. 

In addition to the assignment of the maintenance level capable of 
repairing the discrepancy, the P&E evaluator assigns a defect code of 
minor, major or critical designation. These defect codes are defined by 
NAVAVNLOGCENINST 4730. 7A [Ref. 3] as: 

Minor (Mi) - a defect that does not materially reduce the useability 
of the unit or part for its intended purpose nor is deferral or 
correction likely to impose a disproportionate economic penalty. 
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Major (Ma) - a defect that materially reduces the useability of the 
unit or part for its intended purpose. Correction is subject to the 
operational/economic desires of the aircraft custodian but attention 
is recommended to regain essential operational capability. 

Critical (Cr) - a defect that constitutes a hazardous or unsafe 
condition or, as determined by experience and judgment, could con- 
ceivably become so relative to its deleterious effect on the 
aircraft or its operating personnel. 

An example of the P&E evaluator's worksheet is presented in Figure 16 
with assigned rework codes and typical discrepancies found during the 
zonal inspection of the fuselage. 

B. PROCESS 

Based on the maintenance level/defect codes possible for assignment 
by the P&E (0/Mi, O/Ma, O/Cr, D/Mi, D/Ma , D/Cr) plus a category for "no 
defect", Figure 17 suggests a ranking of severity of defect from least 
severe (No Defect) to most severe (Depot/Critical). To quantify the 
ASPA process we have divided the priority vector elements of the 
Pairwise Comparison Matrix by six, the number of categories available 
for assignment by the P&E evaluator during an ASPA inspection, and 
multiplied this number by 10,000 to attain a linear weighting factor. 
For example. Zonal Area 15 (fuselage) has a priority value of 0.15007. 
This value divided by six and multiplied by 10,000 results in a point 
value equal to 250.12. 

This number represents the difference in weighting between each of 
the assignable categories. The "No Defect" category is assigned a value 
of zero points and "Depot/Critical", the most severe category, is 
assigned the full point value. Using Zonal Area 15 as an example, the 
point assignment breakout would be as follows: 
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Figure 16. Example Planner and Estimator (P&E) ASPA Worksheet 
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No Defect 

Organizational Minor 
Organizational Major 
Organizational Critical 
Depot Minor 
Depot Major 
Depot Critical 



750.35 points 
1,000.47 points 
1,250.58 points 
1,500.70 points 



0 points 
250.12 points 
500.23 points 



To apply these weighting factors to the ASPA process we propose that 
the P&E evaluator total the number of discrepancies in each severity of 
defect category for each zonal area, and multiply this number by the 
appropriate category v/eight. For example, using Zonal Area 15, if the 
P&E evaluator discovered three Organizational Minor (0/Mi) discrepancies 
and two Depot Major (D/Ma) discrepancies, the Zonal Area ASPA score 
would be: 



The overall ASPA score would then be determined by summing all the 
zonal area ASPA score inputs. Table 3 presents the Quantitative ASPA 
Evaluation Scoresheet we have developed from the zonal area priority 
values. This scoresheet is designed to be used by the P&E evaluator 
after the ASPA inspection is completed. The P&E simply annotates the 
number of discrepancies by severity category, and performs the 
appropriate calculations to find the specific aircraft's ASPA score. 

Once the NARF Alameda S-3A Engineering Branch has collected a number 
of ASPA scores, a threshold score for determining the induction decision 
can be established. This threshold score could be found by comparing 
the ASPA scores of aircraft recommended for induction versus the ASPA 



= [(3) (250.12) + (2) (1 ,250.58)] 



= 3,251.52 
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TAB'LE 3. QUANTITATIVE ASPA EVALUATION SCORESHEET 
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19 NOSE LANDING GEAR & WELL I43.12 x 286.23 k 429.35 k 572.47 k 715.58 k 858.70 k 

20 OVERALL PAINT CONDITION 82.03k 164.07 k 246.10k 328.13k 410.17k 492.20 k 



scores of those aircraft that are extended on operational duty. The 
result of this comparison should be the generation of a maximum ASPA 
score or threshold value. Aircraft which fall under this value will be 
extended and those which exceed it will be inducted into SDLM rework. 

C. SUMMARY 

In this chapter we have proposed a methodology to consolidate the 
rankings developed through the AHP into a single value for each in- 
spected aircraft. We have not removed all of the subjectivity from the 
S-3A ASPA process but we have accomplished our goal of proposing a 
methodology for quantifying the S-3A ASPA program. The subjectivity 
that remains at this point is the P&E evaluator's selection of the 
appropriate defect category. By the very nature of the ASPA process, 
this choice must remain under the control of the P&E evaluator. 
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VI. SUMMARY, CONCLUSIONS AND RECOMMENDATIONS 



A. SUMMARY 

This study has focused on the quantification of the previously 
subjective S-3A ASPA process. By first presenting a background and 
general overview of the ASPA concept, we have set the framework for 
analyzing the specific S-3A Viking ASPA process. We have discovered 
that the S-3A ASPA process is different than the ASPA process for all 
other Type/Model/Series aircraft in the Navy's inventory. The S-3A ASPA 
process evaluates zonal areas of the aircraft while the other 
Type/Model/Series aircraft use a leading indicator (i.e., specific 
component inspection) methodology during an ASPA evaluation. 

Since the S-3A ASPA process employs a zonal area evaluation 
technique we were forced to search for a unique methodology that 
approached the quantification problem in a logical and analytical 
manner. The model we have chosen is the Analytical Hierarchy Process 
(AHP) developed by Dr. Thomas L. Saaty. The AHP is based upon three 
principles of logical analysis. The principle of structuring 

hierarchies was carried out by adapting the ASPA concept to the AHP 
hierarchial structure. The principle of setting priorities required 
developing a Pairwise Comparison Matrix for the zonal areas of the S-3A, 
the values of which were determined by consulting an experienced P&E 
evaluator. This matrix was then mathematically manipulated to produce a 
quantitative measure of the relative priority each zonal area con- 
tributes to the SDLM induction decision. Finally, we attempted to apply 
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the principle of logical consistency. Unfortunately, the amount of 
effort required was considered beyong the time available. 

Once the priority of each zonal area had been determined an 

observable scale was developed to reduce the P&E's rankings to a single 
number. In essence, this number described an aircraft's general 
material condition. After a suitable database has been collected, a 

threshold score should be able to be determined. Then, when a specific 
aircraft is inspected and its score assigned, the recommendation of 

induction/no induction can be determined by comparing the aircraft’s 

ASPA score to the threshold value. A score above the threshold dictates 
the aircraft goes to rework and a score below the threshold indicates 
the aircraft can stay on operational duty (PED extension). 

B. CONCLUSIONS 

The quantified ASPA format that we have developed will eliminate 
most of the variation that now exists between the P&E's induction 
recommendations. By implementing our process the management staff of 
NARF Alameda will no longer have the problem of identifying the "hard" 
or "easy" grader. Even without being able to test for consistency, we 
feel that the process we have developed is workable and should be 
incorporated by NARF Alameda for quantifying the ASPA process for the 
S-3A Viking. 

C. RECOMMENDATIONS 

Specific recommendations to NARF Alameda include: 

(1) Attempt to reduce any inconsistency in the Pairwise Comparison 

Matrix for the S-3A by forming a task group to develop a 
consensus of the proper weights for each pairwise comparison. 
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(2) Monitor the number of aircraft that pass/fail the quantitative 
ASPA inspection and ensure that the evaluation criteria are 
accurate and in conformance with the latest Navy directives. 

(3) Analyze any future ASPA inspection data that will be generated 
and make certain that consistency is maintained. 

The general material condition of the S-3A was the focus of this 
study. Although this factor was the only one evaluated in the ASPA 
process, we feel that other criteria should also be considered. These 
can easily be incorported into the AHP by the development of separate 
matrices for each new criterion. Criteria such as cost, safety of 
flight and operational readiness are examples of areas that could be 
studied . 
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APPENDIX A 



S-3A LOCAL ENGINEERING SPECIFICATION (LES) 



This appendix presents the NARF Alameda LES for the S-3A Viking 
aircraft ASPA program. 
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DEPARTMENT OF THE NAVY 
Naval Air Rework Facility 
Naval Air Station 
Alameda, California 94501 



312: JKH 
7 Aug. 1985 
Page 1 of 6 

TITLE: S-3A Local Engineering Speci f i cati on 

IDENTIFICATION/C LA SSFICATION GEN/AL 12-9 -0058 

SYSTEM: S-3A Aircraft 

SU8JECT: S-3A Aircraft Service Period Adjustment (ASPA) Inspection; 

guidelines for 

REFERENCE: (a) NAVA YNLOGCEN PATUXENT RIVER MO 011844Z NOV 82. 

(b) NALC Patuxent River MD Itr 3138/13023/8166 of 15 Mar 83 

(c) NALC Patuxent River MD ltr 405/4710/3118 of 25 Aug. 83 

(d) CNO Washington DC 3017132 Dec 83 

(e) NAVA VNLOGCEN PATUXENT RIVER MO 201602Z Jan 84 

(f) NAVA VNLOGCEN PATUXENT RIVER MD 151533Z Feb 84 

(g) NAVAIR 01 -S 3AAA-6 

(h) NAVAIR 01-S3AAA-6-3 
(1 ) LES GEN/AL 02-2-0150 



ENCLOSURE: (1) Aircraft E 5 E Report 

1 . PURPOSE :To define S-3A and derivative aircraft inspection 
procedures and requirements for a depot inspection team in the field 
to assess aircraft material condition and suitability for a 12 month 
Increase to the present operating service period end date (PED). 

2. CANCELLATION : None. 

3. BACKGROUND : This directive was prepared as requested by 

r eYe rence ( a ) ,out 1 i ned In refs (b),(c), and (d), and modified by refs 
(e) and (f) to provide a disciplined procedure for maintaining positive 
control of aircraft material condition for aircraft required to be 
operated beyond the present PED. 

4. APPLICATION : This directive applies to all S-3A and ' 
derivative aircraft requiring qualification for an Increase to their 
current PED. The inspection specified in this directive shall be 
accomplished by a depot ASPA inspection team from a Depot Rework Point 
(DRP) as directed by the NA VA VNLOGCEN. The ASPA inspection must be 
conducted within the six months prior to PED of an aircraft as 
requested by the reporting custodian. The ASPA inspection shall 
result in either a recommendation that the aircraft be Inducted In SDLM 
within 90 days of PED or that the aircraft's PEO be adjusted twelve 
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months beyond the current PED. Aircraft not recommended for deferral 
and not Inducted within 90 days of PED snail be grounded. 



4.1 INSPECTION TEAM : A certified ASPA Inspection team will be 
responsible for accomp 1 1 shl n g the Inspection requirements and reporting 
the aircraft suitability for a twelve month PED Increase. The ASPA 
Inspection team will consist of : 

(a) One (1) Planner & Estimator 

(b) Appropriate Trade Skills as required. 

5. SPECIAL TOOLS AND TEST EQUIPMENT : a). Paint film thickness 
detector for A1 umi num base f ouncat ion (Vector 121 NDI Instruments Inc. 
or equi valent ) .b) . Articulating Borescope. 

6. SPECIAL MATERIALS : None. 

7. EFFECTIVE PATE : 1 SEPT 35. 

8. 1 N STR f J CTI ON S : The following Instructions are guidelines for 
a n Aircraft Ser vice Period Adjustment (ASPA) Inspection of aircraft 
for possible tour extension (s) beyond the peacetime Operation 
Service Period (OSP) Period End Date (PED). Tne ASPA Inspection 
shall be performed at a shore facility designated by the aircraft 
controlling custodian. The ASPA Inspection shall be performed by a 
Field Team - delineated In paragraph 4.1 of this specification. 
Organizational and Intermediate Level maintenance personnel will 
assist with the inspection ?s required. 

8.1 Aircraft Record Analysis. 

8.1.1 Review Maintenance Action Forms OPNAV 4790/41) Naval Aircraft 
Flight Records (Yellow sheets, OPNAV 3760/2) and the aircraft log book 
for Identification of repeat problem areas, unusual conditions, or 
significant maintenance actions (Including structural repairs). This 
historical performance shall be analyzed to determine possible chronic 
system and component trouble areas for added emphasis during aircraft 
examination. The squadron maintenance personnel familiar with the 
aircraft being evaluated shall be Interviewed , whenever possible, to 
gain additional Information regarding potential problem areas or for 
other considerations to be used In determining If an extension will be 
recommended. 

8.1.2 Review the Periodic Maintenance Information Conditional (PMICs) 
manuals, reference (g), scheduled removal components for high-time 
components . 

8.1.3 Review the Technical Directives Section, (OPNAV 4790/24A), or List 
2 of the Aircraft Log Book to determine Incorporated technical 
directives which would be required If the aircraft were extended. 

8.1.4 Examine Aircraft Log Book and available maintenance and historical 
records to determine and record Items listed below. This 
Information shall be submitted to the Naval Air Rework 
Facility , Alameda, Ca 1 1 f o rn 1 a , Co de 311/312 after the ASPA 



64 



Inspection has been performed. 

8. 1.4.1 Aircraft Bureau Number. 

8. 1.4. 2 Tour Number and present extension number. 

8. 1.4. 3 Total Operational service months and months -1 n-tour . 

8. 1.4.4 Last SDIM completion date. 

8. 1.4. 5 Total flight hours and hours -1 n-tour . 

8. 1.4. 6 Number and Type of Landings (total) , field, carrier, FCLP, and 
bolters. 

8. 1.4. 7 Number and type of arrestments (carrier and field). 

8. 1.4. 8 Number of catapults. 

8. 1.4. 9 Non-aging time accumulated since last SDLM. 

8.1.4.10 History of damage, overstress, ha r d/ o v e rwe i gh t landings, 

chronic or unusual, maintenance problems, special 
operatl condi t 1 ons , and major component replacements. 

8.1.4.11 Last phase Inspection and date. 

8.2 Detailed Inspection Requirements: Compliance with the following is 
required to determine -ai rcraft suitability for tour extension. 

8.2.1 Custodian wash aircraft in accordance with reference (h) to 
prepare aircraft for inspection. 

a). Visually Inspect entire paint system for evidence of : 

(1) Paint lifting (poor adhesion). 

(2) Blisters 

(3) Checlced coatings, erosion and corrosion (especially 

around fasteners . ) 

( 4 )C h e c k the thickness of the paint film around areas that 
are listed below. (Using Vector 121 or equivalent) Use 
an average of three readings If there Is wide discrepancy 
In the readings. 2 mils or less Is cause for repainting. 

a. L/H aileron, center underside, BL 365. 

b. L/H wing top side. Intersection of FS 338 and BL 94. 

c. L/H fuselage, Intersection of FS 326 and BL 38.8 

d. R/H aileron, center, underside BL 365. 

e. R/H flap, center, underside BL 320 

f. R/H wing, top side Intersection of FS 338 and BL 94 

g. L/H fusel age ,1 ntersect 1 on of FS 519.4 and WL 200 

h. L/H upper main landing gear , rear corner , FWD of and 
below of Intersection of FS 496.6 and WL 200. 
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1. L/H f u se 1 a ge , 1 nt e r sec 1 1 on of F$ 333.8 and WL 130 

j. R/H fuselage, Intersection of FS 584.0 and WL 200. 

k. R/H main landing gear door, upper aft corner, FWO of 
and below of the Intersection of FS 496.5 and WL 200. 

l. R/H fusel age , 1 ntersect 1 on of FS 333.8 and WL 130. 

m. R/H fusel age , 1 ntersect 1 on of FS 279.7 and WL 180. 

b) . Perform wet and dry tape test as outlined In reference (1) 

c) . Cosmetic appearance should not be considered. 

d) . Repair capability Is "O* level for touch-up and "D* level 

complete repainting. 

8.2.2 Inspect nose radome using tap test technique. 



a) . Check each Radome for delamlnatlon and structural damage. 

Radomes found to have delamlnatlon flaws beyond tnree 
Inches, but less than eight Inches, In any direction must 
be repaired within 30 days. Radomes with de 1 am i n a 1 1 o n s In 
excess of eight Inches In any direction must be replaced or 
repaired prior to the next flight. All the above applies 
except in the cap area , where any delamination flaws 
greater than three inches must be replaced or repaired prior 
to the next flight. 

b) . Repair requires Depot Level Capability. 



8.2.3 Open all listed panels (and any other panels designated by the 
on-site P 5 E). Access panels are noted by numbers in parentheses. 
Inspect the following areas for cracks, corrosion, loose or missing 
fasteners, loss of paint, paint blisters cleaniness, obstructed drain 
holes, and water entrapment. 

8. 2. 3.1 Internal Upper Fin (9111-1 and 9131-1) 

8. 2. 3. 2 Internal Engine Pylon (10112-2 and 10131-1) 



8. 2. 3. 3 Fin Stub Horizontal stabilizer cutout (7121-1,8121-1, 6133-1 , and 
5132-1) 

8. 2. 3. 4 Internal rear fuselage (5133-1,5232-1, 5232-2) 



8.2.3.5Inspect Inside the following wing panels and all flight control 
push rods, linkages, bearings, bushings, bellcranks, and 
fasteners. 



1131-2 


3213-4 


3232-2 


4213-1 


4232-1 


7231-1 


3123-1 


3213-5 


4123-1 


4123-2 


4232-2 


8211-1 


3212-2 


3231-1 


4212-1 


4213-4 


4232-3 


8211-2 


3212-4 


3221-3 


4212-2 


4213-5 


5111-1 


8221-1 


3212-5 


3231-6 


4212-3 


4231-3 


6111-1 


8231-1 


3212-6 


3231-7 


4212-4 


4231-5 


7211-1 


9113-2 


3213-2 


3231-9 


4212-5 


4231-6 


7211-2 


10121-1 
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3213-3 3232-1 4212-6 4231-7 7221-1 10122-1 

3 • 2 . 3 . 5 With wings spread, check for binding In the following systems: 

( a ) Trailing edge flaps 
(b) Leading edge flaps 
( c ) Spol 1 ers 



8.2.4 Remove sonobuoy reference system antennas, P/N 673096 from tne 
lower surface of the outer wing. Antennas are located at buttock lines 
258 and 340 on port and starboard wings. Inspect i nteri or *ci rcumf erence 
of exposed hole for corrosion. 

8.2.5 Inspect landing gear and wheel wells for corrosion, loose or 
missing fasteners and deformation. Pay particular attention to the nose 
landing gear launch bar assembly, trunnions, drag struts upports ,a nd 
nose jack fittings. 

8.2.6 Inspect arresting gear hook well for cracks, corrosion, loose 
or missing fasteners, and deformation. Inspect left an'd right hand gear 
supports and fillet radii at the base of the supports for cracks and 
corros i on . 

8. 2. 6.1 Inspect arresting gear drag link. Inspect apex radii at base of 
the supports for cracks and corrosion. 

8.2.7 Remove panels 9123-2, and 9223-2. Inspect the structure about 
the Horizontal stabilizer support bracket. Inspect for appearance of 
cracks in the fillet areas on the angle and lower beam structure aft of 
the horizontal stabilizer support hinge, pay particular attention to the 
right side. 

8.3 Evaluation and Reporting. 

8.3.1 Record requirements and inspection results on the Aircraft E & E 
Report, enclosure (1). The report shall identify all defects. 
Documentation shall include identification of the LES inspection which 
led to the defect discovery. The ASPA Inspector and an authorized 
representat i v e of the reporting custodian are to sign the Inspection 
Summary Report. A signed copy of the report shall be provided to the 
reporting custodian and to the Naval Air Rework Facility, Code 310 and 
312, Naval Air Station, Alameda, California 94501. The CFA copy must 
include tje WUC applicable to each individual di screpancy,the 
malfunction code, and the when discovered code. The when discovered code 
shall indicate wnen the defect should have been discovered if the ASPA 
had not been performed. The WUC and these codes are only required for 
Critical and Major items. 




A1 1 erons 
El evators 
Rudder 



8. 2. 3. 6.1 Fold wings and Inspect: 



(a) Separable bellcranks 

(b) Wing fold area. 
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3.3.2 Notify Weapons Systems Engineering Division, Code 310, of any 
unusal damage founded, that Is not associated with al rcraft age or 
service history. For example: Indication of primary structure 

overstress. Code 311 will determine subsequent inspections and repairs. 

8.3.3, The P 1 anner-Es t 1 mator on the ASPA Inspection Team , will prepare 
a Naval Message Report on site. Neither Organization nor Intermediate 
Level defects are to be reported in this message. Included arethe 
following In the message text: 

(a) TMS BUNO 

(b) PED 

(c) Tour 

(d) Total operating service months. 

(e) Total operating hours this period 

(f) Total arresting landings this period 

(g) ASPA Inspection date 

(h) Number of ASPA inspections In tour 

(l)Nuraber of manhours expended In the ASPA Inspection 
(Org/Intermediate/Dept) 

(j description of critical and major defects which require 
depot resources for repair with an estimate of total man 
hours . 

(k) Recommendation: A brief narrative as to the suitability of 

the aircraft for an ASPA change to the PED, based on the 
overall aircraft condition. Do not assume that any or all 
defects will be corrected. 

(l) Distribution: 

a) . TYCOM 

b) . COMNAYAIRSYSCOM WASHINGTON 

C). NAYAVNLOGCEN PATUXENT RIYER MD 
d). NAYAIREWORKFAC ALAMEDA CA. 

ATTN; CODE 0214, 31 1, 31 2, 521, 551, 553, 

8, 3, 3.1 The ASPA decision will be made by the TYCOM based on the 
message report and in consultation with NA YA YNLOGCEN Depot Management. 
Disposition of any depot repair requirements will be in accordance with 
current emergency repair procedures. 

8.4 Defects which require depot f a c 1 1 1 t 1 es /equ 1 pment to correct, shall 
be noted in the Aircraft Log Book “Miscellaneous History" section. 
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APPENDIX B 



S-3A VIKING ZONAL AREAS 



This appendix presents a pictorial view of the various zonal areas 
of the S-3A Viking aircraft. 
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ZONAL AREA 1 
ZONAL AREA 2 
ZONAL AREA 8 
ZONAL AREA 9 



LEFT HAND WING FOLD: OUTER WING PANEL 

LEFT HAND WING FOLD: INNER WING PANEL 

LEFT HAND INNER WING PANEL SPAR AND FLAP WELL 

LEFT HAND OUTER WING PANEL AFT SPAR AND FLAP WELL 
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ZONAL AREA 3 
ZONAL AREA 4 
ZONAL AREA 5 
ZONAL AREA 6 
ZONAL AREA 7 



RIGHT HAND INNER WING PANEL SPAR AND FLAP WELL 

RIGHT HAND OUTER WING PANEL AFT SPAR AND FLAP WELL 

RIGHT HAND OUTER WING PANEL, TAB AND SPAR 

RIGHT HAND WING FOLD: OUTER WING PANEL 

RIGHT HAND WING FOLD: INNER WING PANEL 



72 



ZONAL AREA 10 




ZONAL AREA 10 HORIZONTAL STABILIZER 
ZONAL AREA 11 LEFT HAND ELEVATOR AND TAB 
ZONAL AREA 12 RIGHT HAND ELEVATOR AND TAB 




TAIL FIN 

ZONAL AREA 13 FIN FOLD 
ZONAL AREA 14 RUDDER 
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ZONAL AREA 15 




FUSELAGE 



ZONAL AREA 15 
ZONAL AREA 16 



FUSELAGE 

ECS COMPARTMENT 




ZONAL AREA 17 LEFT HAND MAIN LANDING GEAR AND WELL 
ZONAL AREA 18 RIGHT HAND MAIN LANDING GEAR AND WELL 




ZONAL AREA 19 NOSE LANDING GEAR AND WELL 
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S-3A VIKING AIRCRAFT 

ZONAL AREA 20 OVERALL AIRCRAFT PAINT CONDITION 
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